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the priority date: (1) a copy of the international application, unless it has been previously communicated by the 
International Bureau or unless it was originally filed in the USPTO; and (2) the basic national fee (see 37 C.F.R. § 
1492(a)). The 30-month time limit may not be extended. 37 C.F.R. § 1.495. 

WARNING: Where the items are those which can be submitted to complete the entry of the international application into 

the national phase are subsequent to 30 months from the priority date the application is still considered to 
be in the international state and if mailing procedures are utilized to obtain a date the express mail 
procedure of 37 C.F.R. §1.10 muit be used (since international application papers are not covered by an 
ordinary certificate of mailing - See 37 C.F.R. §1.8. 

NOTE: Documents and fees must be clearly identified as a submission to enter the national state under 35 USC 3 71 otherwise 
the submission will be considered as being made under 35 USC 111. 37 C.F.R, § 1.494(f). 
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(Express Mail label number is mandatory.) 
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Certificate of mailing (first class) or facsimile tr, 
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Each paper or fee filed by "Express Mail" must have the number of the "Express Mail" mailing label placed thereon 
prior to mailing. 37 C.F.R. § 1.10(b). 

"Since the filing of correspondence under §1.10 without the Express Mail mailing label thereon is an oversight that can 
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Notice of Oct 24, 1996, 60 Fed Reg. 56.439, at 56.442. 
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1. Applicant herewith submits to the United States Elected Office (EOAJS) the following items 
under 35 U.S.C. 371: 

a. [X] This express request to immediately begin national examination procedures (35 

U.S.C. 371(f)). 

b. [X] The U.S. National Fee (35 U.S.C. 371(c)(1)) and other fees (37 C.F.R. § 1.492) 

as indicated below: 



2. Fees 



CLAIMS 
FEE 


(1) FOR 


(2) NUMBER 
FILED 


(3) NUMBER 
EXTRA 


(4) RATE 


(5) CALCULATIONS 


[ ]* 


TOTAL CLAIMS 


9-20 = 


0 


X $18.00 = 






INDEPENDENT 
CLAIMS 


4-3 = 


1 


X $80.00 = 


$80.00 




MULTIPLE DEPENDENT CLAIM(S) (if applicable) 




BASIC 
FEB** 

SMALL 
ENTITY 


[ ] U.S. PTO WAS INTERNATIONAL PRELIMINARY 
EXAMINATION AUTHORITY 

1 .482 has been paid on the international application to the U.S. PTO: 
[ ] and the international preliminaty examination report states 
that tfie criteria of novelty, inventive step (non- 
obviousness) and industrial activity, as defined in PCX 
Article 33(2) to (4) have been satisfied for all the claims 
presented in the application entering the national stage (37 

CFR 1.492(a)(4)) .$100.00 

[ ] and the above requirements are not met (37 CFR 

[X] U.S. PTO WAS NOT INTERNATIONAL PRELIMINARY 
EXAMINATION AUTHORITY 

Where no international preliminary examination fee as set forth 
in § 1.482 has been paid to the USPTO, and payment of an 
international search fee as set forth in § 1 .445(a)(2) to the U.S. 
PTO: 

[ ] has been paid (37 CFR 1 .492(a)(2)) $710.00 

[ ] has not been paid (37 CFR 1.492(a)(3)) SIOOO.OO 

[X] where a search report on the international application has 
been prepared by the European Patent OfBce or the 
Japanese Patent OfSce (37 CFR 1.492(a)(5)) $860.00 


S860.00 


Total of above Calculations 


= S940.00 


Reduction by 'A for filing by small entity, if applicable. Affidavit must be filed, 
(note 37 CFR 1.9, 1.27, 1.28) 


- $ 


Subtotal 


$940.00 


Total National Fee 


$940.00 


Fee for recording the enclosed assignment document $40.00 (37 CFR 1.21(h)). 
(See Item 13 below). See attached "ASSIGNMENT COVER SHEET'. 




TOTAL 


Total Fees enclosed 


$940.00 



[X] A check in the amount of $940.00 to cover the above fees is enclosed. 

[ ] Please charge Account No in the amount of $ 

A dupUcate copy of this sheet is enclosed. 
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■■* WARNING: "To avoid abandonment of the application the applicant shall furnish to the United States Patent and 
Trademark Office not later than the expiration of 30 months from the priority date: * * * (2) the basic 
national fee (see § 1.492(a)). The 30-month time limit may not be extended. "37 C.F.R. § 1.495(b). 

VARNING: If the translation of the international application and/or the oath or declaration have not been 

submitted by the applicant within thirty (30) months from the priority date, such requirements may be 
met within a time period set by the Office. 37 C.F.R. § 1.495(b)(2). The payment of the surcharge set 
forth in § 1.492(e) is required as a condition for accepting the oath or declaration later than thirty (30) 
months after the priority date. The payment of the processing fee set forth in § 1.492(f) is required for 
acceptance of an English translation later than thirty (30) months after the priority date. Failure to 
comply with these requirements will result in abandonment of the application. The provisions of§ 1.136 
apply to the period which is set. Notice of Jan. 3, 1993, 1147 O.G. 29 to 40. 

S. [X] A copy of the International application as filed (35 U.S.C. 371(c)(2)): 

WTE: Section 1.495 (b) was amended to require that the basic national fee and a copy of the international application 
must be filed with the Office by 30 months from the priority date to avoid abandonment "The International 
Bureau normally provides the copy of the international application to the Office in accordance with PCT Article 
20. At the same time, the International Bureau notifies applicant of the communication to the Office. In 
accordance with PCT Rule 47. 1, that notice shall be accepted by all designated offices as conclusive evidence that 
the communication has duly taken place. Thus, if the applicant desires to enter the national stage, the applicant 
normally need only check to be sure the notice from the International Bureau has been received and then pay the 
basic national fee by 30 months fi-om the priority date." Notice of Jan. 7, 1993, 1147 O.G. 29 to 40, at 35-36. See 
item 14c below. 

a. [X ] is transmitted herewith. 

b. [ ] is not required, as the application was filed with the United States Receiving 

Office. 

c. [ ] has been transmitted 

i. [ ] by the International Bureau. 

Date of mailing of the application (from form PCT/IB/308): 

ii. [ ] by applicant on 

Date 

\. [X] A translation of the International application into the English language (35 U.S.C. 
371(c)(2)): 

a. [X] is transmitted herewith. 

b. [ ] is not required as the application was filed in English. 

c. [ ] was previously transmitted by applicant on 

Date 

d. [ ] will follow. 

5. [ X ] Amendments to the claims of the International application under PCT Article 19 (35 
U.S.C. 371(c)(3)): 

NOTE: The Notice of January 7, 1993 points out that 37 C.F.R. i 1.495(a) was amended to clarify the existing and 

continuing practice that PCT Article 19 amendments must be submitted by 30 months from the priority date and 
this deadline may not be extended. The Notice further advises that: "The failure to do so will not result in loss of 
the subject matter of the PCT Article 19 amendments. Applicant may submit that subject matter in a preliminary 
amendment filed under section 1.121. In many cases, filing an amendment under section 1.121 is preferable since 
grammatical or idiomatic errors may be corrected. " 1147 O.G. 29-40, at 36. 
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a. [ ] are transmitted herewith. 

b. [ ] have been transmitted 

i. [ ] by the hitemational Bureau. 

Date of mailing of the amendment (from form PCT/IB/308): 

ii. [ ] by applicant on 

Date 

c. [X] have not been transmitted as 

i. [X] applicant chose not to make amendments under PCX Article 19. 
Date of mailing of Search Report (from form PCT/ISA/210): 

ii. [ ] the time limit for the submission of amendments has not yet expired. 

The amendments or a statement that amendments have not been 
made will be transmitted before the expiration of the time limit under 
PCTRule 46.1. 

[ X ] A translation of the amendments to the claims under PCT Article 19 (38 U.S.C. 
371(c)(3)): 

a. [ ] is transmitted herewith. 

b. [ ] is not required as the amendments were made in the English language. 

c. [X] has not been transmitted for reasons indicated at point 5(c) above. 

[X] A copy of the international examination report (PCT/lPEA/409) 
[X] is transmitted herewith. 

[ ] is not required as the application was filed with the United States Receiving 
Office. 

[ X ] Annex(es) to the international preliminary examination report 

a. [ X ] is/are transmitted herewith. 

b. [ ] is/are not required as the application was filed with the United States 

Receiving Office. 

[ X ] A translation of the annexes to the international preliminary examination report 

a. [ X ] is transmitted herewith. 

b. [ ] is not required as the annexes are in the English language. 

[X] An oath or declaration of the inventor (35 U.S.C. 371 (c)(4)) complying with 35 
U.S.C. 115 

a. [ ] was previously submitted by applicant on 

Date 

b. [ ] is submitted herewith, and such oath or declaration 

i. [ ] is attached to the application. 

ii. [ ] identifies the application and any amendments imder PCT Article 19 

that were transmitted as stated in points 3(b) or 3(c) and 5(b); and 
states that they were reviewed by the inventor as required by 37 
C.F.R 1.70. 

iii. [ X ] will follow. 
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Other document{s) or information included: 

11. [X] An International Search Report (PCT/ISA/210) or Declaration under PCT Article 

17(2)(a): 

a. [ ] is transmitted herewith. 

b. [ X ] has been transmitted by the Intemational Bureau. 

Date of mailing (from form PCT/IB/308): sno/no 

c- [ ] is not required, as the application was searched by the United States 

Intemational Searching Authority, 
d. [ ] will be transmitted promptly upon request. 

e- [ ] has been submitted by applicant on 

Date 

12. [X] An Information Disclosure Statement under 37 C.F.R. 1 .97 and 1 .98: 
a. [ X ] is transmitted herewith. 

Also transmitted herewith is/are: 
[ X ] Form PTO-1449 (PTO/SB/08A and 08B). 
[ X ] Copies of citations listed, 
b- [ ] will be transmitted within THREE MONTHS of the date of submission of 
requirements under 35 U.S.C. 371(c). 

c. [ ] was previously submitted by applicant on 

Date 

13. [ ] An assignment document is transmitted herewith for recording. 

A separate [ ] "COVER SHEET FOR ASSIGNMENT (DOCUMENT) ACCOMPANYING 
NEW PATENT APPLICATION" or [ ] FORM PTO 1595 is also attached. 



[X] Additional documents: 

a. [ ] Copy of request (PCT/RO/1 01) 

b. [ X ] Intemational Publication No. WOOn/18117 
i- [X ] Specification, claims and drawing 

[ ] Front page only 



[ ] 

[X] 



Preliminary amendment (37 C.F.R. § 1.121) 
Other 



Form PrT/m/308 



Form PCT/mnOd 



Form prT/mnni 



FormPCT/IRA^? 



22 Sheets of Formal Drawings 



[X] The above checked items are being transmitted 

a. [X] before 30 months from any claimed priority date. 

b. [ ] after 30 months. 
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16. [ ] Certain requirements under 35 U.S.C. 371 were previously submitted by the 
applicant on , namely: 



AUTHORIZATION TO CHARGE ADDITIONAL FEES 

WARNING: Accurately count claims, especially multiple dependent claims, to avoid unexpected high charges if extra 
claims are authorized. 

NOTE: "A written request may be submitted in an application thai is an authorization to treat any concurrent orfiiture 
reply, requiring a petition for an extension of time under this paragraph for its timely submission, as 
incorporating a petition for extension of time for the appropriate length of time. An authorization to charge all 
required fees, fees under § 1.17, or all required extension of time fees will be treated as a constructive petition for 
an extension of time in any concurrent or future reply requiring a petition for an extension of time under this 
paragraph for its timely submission. Submission of the fee set forth in § 1.1 7(a) will also be treated as a 
constructive petition for an extension of time in any concurrent reply requiring a petition for an extension of time 
under this paragraph for its timely submission. "37 C.F.R. § 1. 136(a)(3). 

NOTE: "Amounts of twenty-five dollars or less will not be returned unless specifically requested within a reasonable 

time, nor will the payer be notified of such amounts; amounts over twenty-five dollars may be returned by check 
or. if requested by credit to a deposit account. " 37 C.F.R. § 1.26(a). 

[X] The Commissioner is hereby authorized to charge the following additional fees that 
may be required by this paper and during the entire pendency of this application to 
Account No. 04-1105. 

[X] 37 C.F.R. 1 .492(a)(1), (2), (3), and (4) (filing fees) 

WARNING: Because failure to pay the national fee within 30 months without extension (3 7 C.F.R. § 1.495(b) (2)) 
results in abandonment of the application, it would be best to always check the above box. 

[X] 37 C.F.R. 1 .492(b), (c) and (d) (presentation of extra claims) 

NOTE: Because additional fees for excess or multiple dependent claims not paid on filing or on later presentation must 

only be paid or these claims cancelled by amendment prior to the expiration of the time period set for response by 
the PTO in any notice of fee deficiency (37 C.F.R. § 1.492(d)), it might be best not to authorize the PTO to charge 
additional claim fees, except possible when dealing with amendments after final action. 

[X] 3 7 C.F.R. 1 . 1 7 (application processing fees) 
[X] 37 C.F.R. 1.17(a)(l)-(5)(extension fees pursuant to § 1.136(a). 
[ ] 37 C.F.R. 1.18 (issue fee at or before mailing of Notice of Allowance, 
pursuant to 37 C.F.R. 1.311(b)) 

NOTE: Where an authorization to charge the issue fee to a deposit account has been filed before the mailing of a Notice 
of Allowance, the issue fee will be automatically charged to the deposit account at the time of mailing the notice 
of allowance. 37 C.F.R. § 1.311(b). 

NOTE: 3 7 C.F.R. 1.28(b) requires "Notification of any change in loss of entitlement to small entity status must be filed in 
the application . . . prior to paying, or at the time of paying . . . issue fee. " From the wording of 37 C.F.R. § 
1.28(b): (a) notification of change of status must be made even if the fee is paid as "other than a small entity" and 
(b) no notification is required if the change is to another small entity. 
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[ ] 37 C.F.R. § 1.492(e) and (f) (surcharge fees for filing the declaration and/or 
filing an English translation of an Intemational Application later than 30 
months after the priority date). 




;nature of practitioner 
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Tel. No.: (617)523-3400 
Customer No.: 21874 



David G. Cnnlin 



(type or print name of practitioner) 

Dike, Bronstein, Roberts & Cushman 
Intellectual Property Practice Group 
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1 30 Water Street 

P.O. Address 



Boston, MA 02109 
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SPECIFICATION 

Motion Picture Editing Method, Motion Picture Editing Apparatus and 
Motion Picture Playback Apparatus 

Technical Field 

The present invention relates to a motion picture editing method and 
a motion picture editing apparatus editing motion picture data played and 
output from at least one motion picture file stored on a recording medium 
and having a motion picture data body arranged in temporal order along 
with time management information. 

Background Art 

Multimedia information employed for the so-called streaming 
playback playing data while receiving the same is described with reference 
to Fig. 23. Each multimedia information, independently stored as a single 
completed file per certain unit, is formed by header control information 
indicating the attribute, the property etc. of the overall multimedia 
information included in this file and a multimedia data body. 

The header control information includes control information related 
to the overall multimedia information stored in the file, such as a file 
identifier (file ID) for specifying the file, the length of the multimedia data 
body, a time required for playing the overall file, the average/maximum bit 
rate, the types and the number of media included in the multimedia data 
body, the dependence relation between the media (an upper layer and a 
lower layer of hierarchized information, a right channel, a left channel, a 
center and a surround of an audio etc.), the association between the media 
(Japanese/EngHsh/French/voice gtddance and subtitles of images and 
voices, Japanese/Enghsh of close captions etc.) and the Hke. 

The header control information also includes information related to 
systematic control, related to only partial media included in the multimedia 
information but necessary for playing the file, such as the frame 
size/resolution of images, a coding method (identification of ITU- 
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Recommendation H.261, H.262, H.263, H26L, ISO standard 11172 (MPEG- 
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1), 13818-2 (MPEG-2), 14496-2 (MPEG-4) or the like, for example), 
parameters (the profile, the level, selection of an option mode etc.) in the 
coding system and the like. 

Further, the header control information also includes information for 
storing the position of the multimedia information, such as index 
information specifying random-accessible positions, proper positions of 
temporally continuous multimedia information, stored marker information 
and the like. 

The index information is utOized for deciding an access position 
halfway through the multimedia information, deciding playback object 
information for playing information in a skipping manner at a high speed 
or the Hke. Specifically, an intra-frame/field coded frame (intra-coded 
frame/fi.eld) or the hke is specified as the index information when coded 
motion picture data is referred to. 

This is because the intra-frame/field coded frame is a proper access 
point since the same is independently coded with no supplementation from 
precedent and subsequent information (frames) or the hke and can be 
individually decoded and played while subsequent motion picture 
information can be sequentially decoded and played on the basis thereof. 

When intra-frame coded frames are periodically inserted as in the 
GOP (Group of Pictures) structure in the coding system such as MPEG-1 or 
MPEG-2, for example, the periodic intra-frame coded frames (heads of 
GOPs) can be specified with the index information respectively. Further, 
the quantity of information of the index information can be reduced by 
providing only indices specifying skipped intra-frame coded frames as one 
for two GOPs or one for three GOPs. 

Thus, when the index information specifies only periodic intra-frame 
coded frames, high-speed playback can be readily implemented at a 
constant rate by merely tracing the index information in high-speed 
playback. 

When scene change or large motion/change is coded by automatically 
inserting detected output or an intra-frame coded frame, the index 
information may also specify the automatically inserted intra-frame coded 



frame, in addition to the aforementioned periodic intra-frame coded &ames. 
In this case, random-accessible positions can be set in more detail although 
periodicity of positions specified by the index information is not guaranteed. 
The data body of the multimedia information is arranged and stored 
5 in order of playback times in such a state that various types of media such 
as motion pictures, voices/audios etc. are intermixed. The order of storage 
is decided only with reference to the times, regardless of the types of the 
media. 

While the data may be stored along the order in filming/recording for 

10 implementing storage in the order of playback times, the order of storage is 
decided in consideration of processing (decoding) delays between reading 
and outputting information, which vary with the media. When 
simultaneously filmed/recorded motion picture and voice are to be 
simultaneously played, the motion picture having a larger decoding delay is 

15 stored in advance by this delay time. 

The data body is stored in temporal order as described above, and 
hence the data may simply be sequentially read from the head of the file, 
decoded and thereafter output when the same is played. When a server 
keeps a file storing multimedia information and transmits the data of the 

20 file through the Internet in response to access fi?om a user, for example, the 
burden on the server can be extremely effectively lightened due to the 
aforementioned characteristic since the server may simply sequentially 
read and send the data body. 

As described later, a time stamp indicating a read/playback time is 

25 appended to each packet of the data body, in order to control the tuning of 
reading and playback. The server is required to send the data body at the 
time according to the time stamp value of the read data body packet. 

This access mode of the multimedia information is referred to as 
streaming transfer (streaming service). 

30 As to the data body of the mvdtimedia information, input information 

may be stored as such, or the information may be compressed and coded by 
the aforementioned coding system. Further, the data body is divided into 
packets of a proper size, and stored as paketed information. Therefore, the 
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data body of the miiltimedia information in the file is formed by a packet 
train of the information of each medium. 

The packets of this data body are created and stored for the 
information of the respective media, and a single packet basically includes 
5 only data of a single medium. The lengths of the packets may be fixed or 
variable. Further, the lengths (the maximum lengths or average lengths 
in the case of the variable lengths) of the packets may completely vary with 
the media, or may be substantially similar to each other regardless of the 
t3T)es of the media. 

10 When the packets have fixed lengths, the lengths are decided in 

response to systematic conditions such as sector lengths, record lengths, 
track lengths etc. of recording media, for example. When the quantity of 
information (bit rate) per hour with respect to the data of the media is 
constant, the quantity of information coincides with time intervals and 

15 hence the packet lengths can be set in response to temporal conditions. 

When the packets have variable lengths, the unit of packeting can be 
decided in response to the properties of the data (coded information) of the 
media. The simplest unit is matched with the unit of 
codLng/decoding/playback output processing such as one coded unit frame 

20 for voices, one frame/field for motion pictures or the Uke. 

In the aforementioned example, however, the quantity of information 
is dis advantageously too small for voices or too large for motion pictures. 
Therefore, the data body is packeted by combining a plurality of coded unit 
frames with each other for voices or further dividing coded information of 

25 one frame/field for motion pictures. 

The unit for dividing coded information of motion pictures may be 
matched with a delimiter in the coded data structure such as a GOB (Group 
Of Blocks) in the coding system of ITU-Recommendation H.261, a GOB or 
an adaptive shce of Recommendation H.263, a slice of Recommendation 

30 H.262 1 ISO Standard 13818-2 (MPEG-2), a shce (video packet) of Standard 
14496-2 (MPEG-4) or the like. 

Further, a packet header indicating the attribute of the packet is 
afiSxed to each packet. The packet header includes the packet length, a 
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flag indicating whether or not the position is random-accessible, the time 
stamp for time management etc. The time stamp indicates the time to 
send the packet to a chent, i.e., the time to start processing on the packet. 
In the format of a multimedia information file X shown in Fig. 23, 
5 the header control information is arranged and stored at the head, followed 
by the multimedia data body. When the file is read from the head in 
playback, the header information is obtained first so that the whole 
situation of the data body can be grasped, a system necessary for playback 
can be set and initialized, and an operation mode can be set. 

10 If the data body is stored at the head followed by the header control 

information to the contrary, the data body can be immediately accessed and 
read when system control and mode setting are unnecessary (no control 
parameter is necessary, the mode is previously known, etc.) in a simple 
playback system, for example. 

15 Further, part of the header control information may be stored at the 

head, followed by the data body and the remaining part of the header 
control information. When index information, marker information and the 
like are not utilized, these data may be arranged at the back of the data 
body so that unnecessary information can be completely ignored in 

20 playback. 

A playback apparatus for the aforementioned multimedia 
information is now described with reference to Fig. 24 and Fig. 25. Fig. 24 
is a functional block diagram showing a conventional playback apparatus 
for multimedia information, and Fig. 25 is a flow chart showing playback 

25 operation in the conventional playback apparatus for multimedia 
information. 

Referring to Fig. 24, the conventional playback apparatus includes a 
time stamp read part 1 reading a time stamp included in each packet 
header from a desired multimedia information file, a playback timer 2 
30 starting counting a timer time on the basis of a playback instruction 

received fi^om a user, a compare part 3 comparing the time stamp read in 
the time stamp read part 1 with the timer time (playback reference time) 
counted by the playback timer 2, and a playback control part 4 outputting 
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the multimedia information file when the timer time is identical to or leads 
the time stamp as a result of comparison in the compare part 3. 

The operation of this playback apparatus is now described with 
reference to the flow chart of Fig. 25. When the user instructs the 
5 playback apparatus to play the multimedia information file, the playback 
timer 2 starts counting the timer time. Further, the playback timer 2 
reads the time stamp included in each packet header fi:om the target 
multimedia information file (step 21), and acquires the current timer time 
« (step 22). 

f£ 10 Then, the compare part 3 compares the time stamp read at the step 

m 2 1 with the timer time acquired at the step 22 (step 23), and when the 

= 1 timer time is identical to or larger than the time stamp, the playback 

y control part 4 starts playing and outputting the multimedia information 

data (step 24). When the timer time is smaller than the time stamp, the 
S 15 process returns to the step 2 and repeats the aforementioned operation. 
3 The playback apparatus is authorized to play and output the packet 

5=i part to which the time stamp is appended only when the time stamp read 

in the time stamp read part 1 is identical to or smaller than the timer time 
counted in the playback timer 2, whereby the data can be output ficom the 
20 head of the file along the order of storage in response to the timer time. 

However, the aforementioned conventional playback apparatus for 
multimedia information plays and outputs the multimedia data body on the 
basis of the result of comparison of the time stamp appended in order of 
playback times in the file and the timer time, and hence, when the 
25 multimedia data body is edited by temporal cut and paste such as 

extraction, division and connection, a new edited multimedia data body 
must be created and stored independently of the unedited multimedia data 
body. Therefore, extremely large areas are disadvantageously required as 
a working area for editing and a storage area for the result of editing. 
30 In order to readily edit and change motion picture data without 

creating new motion picture data from a motion picture file, the following 
method is conceivable: 

When only a part A and a part B are to be extracted, played and 
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output from the multimedia information file X shown in Fig. 23, an 
instruction for playing the part B (a start time stamp 6 and an end time 
stamp 8) subsequently to the part A (a start time stamp 1 and an end time 
stamp 2) is supplied. When the motion picture data is played while 
5 reading the time stamps on the basis of this instruction, however, it foUows 
that the part A is started to he played and displayed when the playback 
time of the playback timer reaches 1, no part is displayed while the timer 
time is 3 to 6 and the part B is started to be played and displayed when the 
timer time reaches 6 as shown in Fig. 26, and the part A and the part B 

10 cannot be continuously played immediately after the playback instruction. 

The playback time for arbitrarily extracted partial data is decided by 
the timer time (playback reference time) of the playback timer and cannot 
be changed with respect to the timer time, and hence the data cannot be 
edited by temporal cut and paste employing extraction, division, connection 

15 and the hke. 

The present invention has been proposed in consideration of the 
aforementioned problems, and an object of the present invention is to 
provide a motion picture editing method and a motion picture editing 
apparatus capable of readily editing a multimedia data body arranged in 

20 temporal order along with time stamps by temporal cut and paste 
employing extraction, division, connection and the hke. 

Disclosure of the Invention 

The motion picture editing method according to the present 
25 invention edits motion picture data played and output j&rom a motion 

picture file stored on a recording medium and having a motion picture data 
body formed by arranging time management information and motion 
picture data corresponding to the said time management information in 
temporal order. 

30 The motion picture editing method previously specifies at least one 

playback range in the motion picture file and a playback time of the 
playback range, appends information for managing the specified playback 
range and the playback time of the playback range to an area other than 
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the motion picture data body on the recording medium as edit information, 
and outputs motion picture data of the specified range in the motion picture 
file at the specified time on the basis of the time management information 
and the edit information. 
5 For example, time management information (time stamp) included in 

the motion picture data body, a physical storage position in the motion 
picture file, a packet number, the serial number of index information, a 
frame/field number, an arbitrary playback time or the like can be employed 
for specifying the playback range. 

10 Preferably, the motion picture editing method changes the time 

management information in the output motion picture data on the basis of 
the edit information, and creates a new motion picture file. 

More preferably, the motion picture editing method appends edit 
information including information for managing the playback time for the 

15 output motion picture data to an area other than the motion picture data 
body on the recording medium, and creates a new motion picture file. 

According to another aspect of the present invention, the motion 
picture editing method edits motion picture data played and output from a . 
motion picture file stored on a recording medium and having a motion 

20 picture data body formed by arranging time management information and 
motion picture data corresponding to the said time management 
information in temporal order. The motion picture editing method 
previously specifies at least one playback range ia the motion picture file 
and a playback time of the playback range, appends information for 

25 managing the specified playback range and the playback time of the 

playback range to an area other than the motion picture data body on the 
recording medium as first edit information, defines an edit resvdt in the 
motion picture file on the basis of the time management information and 
the first edit information, further specifies at least one playback range in 

30 the edit result and a playback time of the playback range, appends 

information for managing the specified playback range and the playback 
time of the playback range to an area other than the motion picture data 
body on the recording medium as second edit information, and outputs 
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motion picture data of the specified range in the motion picture file at the 
specified time on the basis of time management information in the edit 
result and the second edit information. 

According to still another aspect of the present invention, the motion 
5 picture editing apparatus edits motion picture data played and output fi:om 
a motion picture file stored on a recording medium and having a motion 
picture data body formed by arranging time management information and 
motion picture data corresponding to the time management information in 
temporal order. The motion picture editing apparatus includes means 

10 specifying a desired playback range and a playback time of the playback 
range, means extracting specific information of the specified playback 
range and playback time information, means creating edit information on 
the basis of the extracted specific information and playback time 
information and recording the edit information in an area other than the 

15 motion picture data body on the recording medium, and playback means 
plajdng the playback range at the specified time on the basis of the edit 
information. 

According to a further aspect of the present invention, a motion 
picture playback apparatus plays a motion picture file stored on a recording 

20 medium and having a motion picture data body formed by arranging time 
management information and motion picture data corresponding to the 
time management information in temporal order. The motion picture 
playback apparatus includes edit information read means reading edit 
information appended to an area other than the motion picture data body 

25 on the recording medium and including information for managing a 

playback time of the motion picture data, time management information 
read means reading time management information in the motion picture 
data, playback time adjustment means carrjdng out a prescribed operation 
on the time management information read in the time management 

30 information read means and calculating a specified playback time on the 
basis of the information for managing the playback time read in the edit 
information read means, compare means comparing the specified playback 
time calculated in the playback time adjustment means with a time 
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counted by a playback timer, and control means outputting motion picture 
data in the motion picture file at the specified time on the basis of a result 
of comparison in the compare means. 

According to a further aspect of the present invention, the motion 
5 picture editing method appends edit information including information for 
managing a playback time of motion picture data to a motion picture data 
body stored on a recording medium and formed by arranging time 
management information and motion picture data corresponding to the 
time management information in temporal order, and creates a new motion 
10 picture file. The motion picture editing method appends the edit 

information to an area other than the motion picture data body on the 
recording medium. 

Brief Description of the Drawings 
15 Fig. 1 is a schematic diagram showing the appearance of a motion 



-9/1- 



picture editing apparatus to which the present invention is applied. 

Fig. 2 is a diagram showing the structure of an edit information file 
in a motion picture editing method and a motion picture editing apparatus 
according to one embodiment of the present invention. 
5 Fig. 3 is a block diagram showing a part of the motion picture editing 

apparatus recording edit information. 

Fig. 4A and Fig. 4B are schematic diagrams showing the contents of 
information recorded on a recording medium. 

Fig. 5 is a diagram showing an exemplary mtdtimedia information 
10 file of an edit object in the motion picture editing method and the motion 
picture editing apparatus according to one embodiment of the present 
invention. 

Fig. 6 is a functional block diagp:am showing a schematic structure of 
the motion picture editing apparatus according to one embodiment of the 
15 present invention. 

Fig. 7 is a flow chart showing the motion picture editing method 
according to one embodiment of the present invention. 

Fig. 8 is a diagram showing exemplary playback output in the 
motion picture editing method and the motion picture editing apparatus 
20 according to one embodiment of the present invention. 

Fig. 9 is a diagram showing exemplary edit information in the 
motion picture editing method and the motion picture editing apparatus 
according to one embodiment of the present invention. 

Fig. 10 is a diagram showing another exemplary edit information in 
25 the motion picture editing method and the motion picture editing 
apparatus according to one embodiment of the present invention. 

Fig. 1 lA to Fig. lie are diagrams showing an exemplary new 
multimedia information file created from playback output. 

Fig. 12A to Fig. 12D are diagrams showing exemplary new 
30 multimedia information files created from playback output, to which 
dummy data are appended. 

Fig. 13 is a functional block diagram showing a schematic structure 
of a motion picture editing apparatus according to a second embodiment of 
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the present invention. 

Fig. 14A and Fig. 14B are diagrams showing playback output and 
exemplary edit information therefor in the second embodiment. 

Fig. 15A and Fig. 15B are diagrams showing other exemplary edit 
information in the second embodiment. 

Fig. 16A and Fig. 16B are diagrams showing a new mtdtimedia 
information file created from playback output and exemplary edit 
information included in the multimedia information file in the second 
embodiment. 

Fig. 17 is a diagram showing another exemplary edit information 
included in the new multimedia information file created from playback 
output in the second embodiment. 

Fig. 18A, Fig. 18B and Fig. 18C are diagrams showing playback 
output and exemplary edit information therefor in a motion picture editing 
method and a motion picture editing apparatus according to a third 
embodiment of the present invention. 

Fig. 19 is a diagram showing exemplary new multimedia information 
files created firom playback output in the third embodiment. 

Fig. 20 is a diagram showing exemplary edit information included in 
the new multimedia information files created from playback output in the 
third embodiment. 

Fig. 21 is a diagram showing playback output and exemplary edit 
information therefor in a motion picture editing method and a motion 
picture editing apparatus according to a fourth embodiment of the present 
invention. 

Fig. 22A to Fig. 22G are diagrams showing exemplary edit 
information in a motion picture editing method and a motion picture 
editing apparatus according to a fifth embodiment of the present invention. 

Fig. 23 is a diagram showing a schematic structure of a multimedia 
information file. 

Fig. 24 is a block diagram showing a schematic structure of a 
conventional playback apparatus for multimedia information. 

Fig. 25 is a flow chart showing a conventional playback method for 



multimedia information. 

Fig. 26 is a diagram showing a case where only arbitrarily extracted 
partial data is played by the conventional playback apparatus for 
multimedia information. 

5 

Best Modes for Carrying Out the Invention 

One embodiment of the present invention is now described with 
reference to drawings as to operation of extracting, continuously playing 
and outputting an arbitreu^y part from a multimedia information file. The 

10 same reference numerals are assigned to parts identical to those in the 
aforementioned conventional example, and redundant description is not 
repeated- 
Referring to Fig. 1, a motion picture editing apparatus 100 to which 
the present invention is apphed includes a part in which a recording 

15 medium 101 recording multimedia information is inserted for playing the 
recording medium 101 and an edit data input part 102 receiving edit data 
for playing desired data recorded on the recording medium 101. 

Referring to Fig. 1 to Fig. 12D, edit information (partial playback 
specify information) for specifying only a specific part in a data body of 

20 temporally continuously stored multimedia information is appended onto 
the recording medium in this embodiment. This edit information includes 
a playback object file ID, a playback start position, a playback end position, 
playback time management information etc., as shown in Fig. 2. 

Referring to Fig. 3, a part of the motion picture editing apparatus 

25 100 recording the edit information includes an edit data input part 121, an 
edit information creation part 122 creating edit information with received 
edit data and a recording part 123 recording the created edit information 
on the recording medium 101. The edit data input part 121, identical to 
the edit data input part 102 shown in Fig. 1, outputs information (edit 

30 data) necessary for editing. The edit information creation part 122 creates 
the edit information shown in Fig. 2 from the edit data. The recording 
medium 101 records mvdtimedia information and file information thereon. 
Fig. 4A is a schematic diagram showing control information and edit 
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information recorded on the recording medium 101. Referring to Fig. 4A, 
edit information corresponding to a multimedia information file 111 is 
recorded as an independent edit information file 1 12 different from the 
multimedia information file 111. In a multimedia information file 113, 
5 edit information is recorded in the same file. Fig. 4A is a conceptual 
diagram to the utmost, not expressing a physical recorded situation. 

Fig. 4B is a schematic diagram showing the recorded situation of the 
control information and the edit information. Referring to Fig. 4B, files 
may be recorded on continuous addresses as a group (A), or may be 

10 recorded bit by bit on skipped positions (B). The fiiles may not necessarily 
be recorded as shown at A, but can be handled as a single file similarly to 
those shown at A also when recorded as shown at B, by recording the 
respective addresses and the order for linking the addresses in a different 
position (a file allocation table, for example). 

15 In the edit information shown in Fig. 2, N (N: arbitrary integer) 

parts can be specified from a first playback start position, a first playback 
end position, a second playback start position, • •, an N-th playback start 
position, up to an N-th playback end position, so that a plurality of parts 
can be extracted. This is implemented by attaining a description structure 

20 of information capable of enumerating sets of playback start points and 

playback end points by a desired number (N). The number N corresponds 
to an edit element number shown in Fig. 2. 

Thus, when a plurality of playback start points and playback end 
points are specified, it means that N parts are to be concatenated into one 

25 and played when multimedia information data is played on the basis of this 
edit information. 

Playback start positions and playback end positions may be specified 
by a method of directly specifying the data body or a method of specifying 
index information and indirectly specifsdng the data body firom the index 
30 information. 

When the data body is directly specified, either a physical storage 
position (an offset value from the file head or an offset value firom the head 
of the data body, for example) of the specified data body packet in the file or 
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a packet number (a serial number from the head) assigned to the data body 
packet may be specified. 

When the physical storage position in the jfile is specified, the target 
data packet can advantageously be read by seeking through the file in 
5 reading regardless of the structure in the file or the structure and format of 
the data body packet. When the number of the packet is specified, the 
apparatus can be prevented from specifying an erroneous position such as 
an intermediate position of the packet due to excellent consistency with 
management and processing of another data body formed by packets. 

10 When the data body is indirectly specified from the index 

information, either a physical storage position (an ofiset value from the file 
head or an ofiset value from the head of the index information, for example) 
of the specified index information in the file or an index information 
number (a serial number from the head) assigned to the index information 

15 may be specified. 

In this case, only a random-accessible position (intra-frame coded 
frame) indicated by the index information is tacitly specified, as shown in 
Fig. 5. In processing of extracting an edit object position according to edit 
information described later, further, a playback start position can be 

20 decided with index information already present for implementing random 
access or the fike. 

The indirect referee is not restricted to the index information but 
another information may be employed so far as the information (marker 
information, for example) can specify the position of the data body. When 

25 the data body packet and the index information are managed with numbers, 
the numbers may be serial every medium. 

At this time, a medium identify information element indicating 
information of a reference medium for expressing the playback start point 
and the playback end point is appended to the edit information. The 

30 information of the playback start point and the playback end point itself 
may indicate only the packet number of the medium specified by the 
medium identify information, or a narrative style (clarifying the 
combination of the medium and the number as Video-8 or Audio 1-6, for 
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example) capable of specifying the medium may be introduced into the 
information of the playback start point and the playback end point itself. 

In the former method, the medium can be readily specified also when 
the structure of the medium is complicated (two motion pictures and four 
5 voices, for example). In the latter method, different media can be specified 
on the playback start point and the playback end point. 

Particularly in the latter method, not only the position can be 
specified in more detail but also it is possible to prevent a feeling of misfit 
caused by the voice starting from/ending at an improper position when the 

10 playback start position and the playback end position are specified with the 
voice in place of a motion picture having a relatively long continuation time 
of a playback unit (one frame of the motion picture or the Uke). 

Further, the aforementioned methods of specifying positions may be 
used together or intermixed so that the employed method can be properly 

15 selected or specified. In this case, a specification method identify 

information element indicating whether the method is specified with the 
storage position or the number is appended to the edit information for 
identifying the employed method, similarly to the aforementioned 
association of the medium and the number. 

20 As to the playback start point and the playback end point, a method 

of describing information according to the specification method and a 
method of describing the information of the playback start point and the 
playback end point itself in a style capable of identifying the specification 
method (combining method identification and information of the specified 

25 destiaation as Offset. 120 or Index.5, for example) c£in be employed. 

Further, the data body of the mxiltimedia information is managed 
with the playback time, and hence the edit information can include only 
information of the time. At this time, the edit information may include 
only information of the playback time without including direct or indirect 

30 reference to the data body. In this case, control for playback can be 
executed on the basis of only the time regardless of the contents or the 
format of the data body, and hence the processing can be advantageously 
simplified. 
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However, the data body is not referred to (a proper time can be freely 
specified), and hence the specified playback start position and playback end 
position may be inconsistent with the time stamps of the data body. 
Therefore, it is necessary to provide a rule for interpreting the contents (the 
5 playback start position and the playback end position) of the edit 

information as the time stamps (immediately approximate, immediately 
before, immediately after or the Hke, for example) of the data body. 

When only an intra-frame coded frame is employed as a random- 
accessible position, the infra-firame coded frame must be regarded as the 
10 playback start position. 

While this can be automatically implemented when the data body is 
indirectly referred to from the index information as hereinabove described, 
otherwise it is necessary to provide a rule for interpreting the playback 
start position as an intra-frame coded fi:ame immediately before, 
15 immediately after or immediately approximate to the data body. 

When the unit of packeting is a single frame and the data body of the 
multimedia information file is formed by intra-frame coded firames (10, 14 
and 18) and inter-frame coded frames (PI, P2, P3, P5, P6, P7 and P9) as 
shown in Fig. 5 and the inter-frame coded frame P3 is specified as the 
20 playback start position (broken-Mne arrow ® in Fig. 5), for example, the 
intra-frame coded frame 10 immediately before the data body (sohd-hne 
arrow (D in Fig. 5) or the intra-firame coded frame 14 immediately after or 
immediate approximate to the data body (sohd-hne arrow (B) in Fig. 5) is 
pointed in practice. 

25 When an external different file is specified as the playback object file 

ID, unique information such as a file ID included in header control 
information may be employed for the file storing the multimedia 
information or information such as a file name assigned to each file for 
management on the recording medium may be employed. 

30 Further, a rule may be provided for a method of naming the file itself 

such as an extension in the aforementioned file name, for clarifying the 
association between the edit information and the playback object file. 
When the name of the playback object file is foo.mpg, for example, the edit 
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information is provided with a file name foo.edt. 

A rvde for regarding the file foo.mpg as the edit object of the file 
foo.edt when there is no file named foo.* (* is assumed to be an arbitrary 
extension) except the files foo.edt and foo.mpg is so provided that the file 
name of the referee may not be explicitly specified in the edit information 
but the association of the file is clarified without decoding the contents of 
the file. 

The files may be specified with a simple file name, a file name 
including a relative/absolute pass name including a directory etc. in the file 
structure of the recording medium, a file name including a relative pass or 
an absolute pass from a user name in a multi-user system and the directory 
of the specified user, a pass name including the name of an apparatus 
connected on a network + a file name, a pass name including information 
related to an access destination such as a URL and an access method or the 
like + a file name, and any of these file nsimes can be employed 
independently or in combination. 

Thus, the files can be flexibly and fireely specified regardless of the 
positions thereof, due to a technique similar to a method of specifying files 
in a general file system. 

When only a part is extracted firom the source multimedia 
information with the edit information, the contents of the header control 
information must be changed with respect to the extracted data. For 
example, it may be necessary to change time management information 
(time stamp) indicating the time for playing each packet of the data body. 

This is because only a part of the data body originally arranged in 
order of playback times is extracted, and particularly when the playback 
start point indicates an intermediate position of the data body, the initial 
value of the playback start time must be correctly changed. 

When the initial value of the playback start time must be a 
predetermined value (time 0, for example) for plasdng the multimedia 
information, this is introduced into the edit information as playback time 
management information since the difference (offset) between the time 
specified by the playback start point and the initial value must be obtained 
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for adjusting the playback start time. 

In this case, the playback time management information must be 
held for the respective ones of N extracted parts. A plurahty of parts are 
inconsistently extracted from temporally continuous arrangement of the 
data body and concatenated with each other, and hence the playback time 
is adjusted on each part for guaranteeing consistency of the playback time. 

The position for storing the aforementioned edit information is 
located on a part other than the data body, in order to leave the data body 
of the source multimedia information as such without manipxilation. For 
example, the edit information may be included in the header control 
information arranged at the head of the file or the header control 
information arrginged at the end of the file (at the back of the data body), or 
may be stored as a file different from the file storing the data body. 

When these means are used together, a file position identify 
information element indicating whether the specified designations of the 
playback start point and the playback end point are in the same fiile or an 
external different file is appended to the edit information, or the edit 
information is enabled to indicate a file describing the information of the 
playback start point and the playback end point or the external file. 

A schematic structure of the editing apparatus according to this 
embodiment is now described with reference to Fig. 6. Referring to Fig. 6, 
the editing apparatus according to this embodiment includes an edit 
information read part 11 reading the aforementioned edit information, a 
playback object file extract part 12 extracting the miiltimedia information 
file of the playback object from a multimedia information file group stored 
on the recording medium (not shown) on the basis of the playback object 
file ID read in the edit information read part 1 1 and sending the 
multimedia information file to a time stamp read part 1, and a playback 
time adjustment part 13 comparing the playback start position read in the 
edit information read part 11 with the time stamp read in the time stamp 
read part 1 for carr5n.ng out a prescribed operation on the value of the 
aforementioned time stamp following the playback time management 
information read in the edit information read part 11 when the time stamp 
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exceeds the playback start position thereby calculating a spedfied playback 
time and outputting the specified playback time to the compare part 3. 
The editing apparatus further includes a compare part 14 comparing the 
time stamp read in the time stamp read part 1 with the playback end 
5 position read in the edit information read part 11 and outputting a result of 
comparison to a playback control part 4. The editing apparatus further 
includes a time stamp change part 15 changing the value of the time stamp 
in the mxiltimedia information data played and output irom the playback 
control part 4 to the specified playback time calculated in the playback time 

10 adjustment part 13 and a header appending part 16 appending header 
control information to the multimedia information data having the time 
stamp changed in the time stamp change part 15. The time stamp change 
part 15 and the header appending part 16 form a file creation part 17. 

The procedure of playback output in the editing apparatus formed in 

15 the aforementioned manner is described with reference to a flow chart of 
Fig. 7. First, the edit information read part 11 reads the edit information 
(step 1), the playback object file extract part 12 acquires the multimedia 
information data of the playback object file corresponding to the read 
playback object file ID (step 2), and the time stamp read part 1 reads the 

20 time stamp included in the acquired multimedia information data (step 3). 

The time stamp read in the time stamp read part 1 is compared with 
the playback start position read in the edit information read part 11 (step 
4), and when the time stamp reaches the playback start position, the 
prescribed operation is carried out on the value of the time stamp for 

25 calculating the specified playback time (step 5) while the current timer 

time (playback reference time) of a playback timer 2 is acquired (step 6) on 
the basis of the playback time management information read in the edit 
information read part 11. When the time stamp is smaller than the 
playback start position, the process returns to the step 3 Eind repeats the 

30 aforementioned operation. 

The compare part 3 compares the specified playback time obtained in 
the playback time adjustment part 13 with the timer time counted by the 
playback timer 2 (step 7), and when the timer time is identical to or larger 
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than the specified playback time, the playback control part 4 plays and 
outputs another multimedia information (step 8). When the timer time is 
smaller than the specified playback time, the process returns to the step 6 
and repeats the aforementioned operation. 

Further, next multimedia information data is acquired and a time 
stamp included therein is read (step 9). The compare part 14 compares 
this time stamp with the playback end position read in the edit information 
read part 11 (step 10), and when the time stamp is larger than the 
playback end position, the playback control part 4 stops the playback 
output (step 1 1). When the time stamp is identical to or smaller than the 
playback end position, the process returns to the step 5 and repeats the 
aforementioned operation. 

Operation of extracting and connecting the part A (time stamps 1 to 
2) and the part B (time stamps 6 to 8) from the multimedia information file 
X shown in Fig. 23 and plajdng the same at timing shown in Fig. 8 is 
specifically described. In this case, edit information shown in Fig. 9, for 
example, is previously set. 

The part A is played on the basis of the first playback start position 
described as the time stamp 1. The playback time management 
information is described as offset 1, and hence the playback time 
adjustment part 13 subtracts the offset from the time st£unp read in the 
time stamp read part 1 to obtain the specified playback time, and compares 
the obtained specified playback time with the timer time of the playback 
timer 2. 

Therefore, the specified playback time for the packet having the time 
stamp 1 is 1 - 1 = 0, and the part A is started to be played and output when 
the timer time is 0. Similarly, the specified playback time for the packet 
having the time stamp 2 is 2 - 1 = 1, and this part is played and output 
when the timer time is 1. 

When a packet having a time stamp larger than 2 is received, the 
compare part 14 detects this since the playback end position is described as 
the time stamp 2, and the playback control part 4 terminates playing and 
outputting this part. 
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In addition, the part B is played on the basis of the second playback 
start position described as the time stamp 6 in the edit information. The 
playback time management information is described as offset 4, and hence 
the playback time adjustment part 13 subtracts the offset from the time 
5 stamp to obtain the specified playback time, and compares the obtained 
specified playback time with the timer time of the playback timer 2. 

Therefore, the specified playback time for the packet having the time 
stamp 6 is 6 - 4 = 2, and the part B is started to be played and output when 
the timer time is 2. Similarly, the specified playback time for the packet 
10 having the time stamp 8 is 8 - 4 = 4, and this part is played and output 
when the timer time is 4. 

When a packet having a time stamp larger than 8 is received, the 
playback control part 4 terminates playing and outputting this part since 
the playback end position is described as the time stamp 8. 
15 While no packet having a time stamp larger than that indicated by 

the playback end position is received when the multimedia information 
data ends, the playback output is of course ended when there is no input 
data itself. 

While the playback start position and the playback end position are 
20 employed for describing the specified playback range in the above 

exemplary edit information, the present invention is not restricted to this 
but a playback duration can be employed in place of the playback end 
position as shown in Fig. 10, for example. In this case, the playback end 
position may be calculated from the playback start position and the 
25 playback duration and input in the compare part 14. 

Further, the timer time itself can be described as the playback time 
management information, in place of the offset. In this case, the playback 
time adjustment part 13 may simply replace the value of the time stamp 
with the playback time management information (timer time). 
30 According to this embodiment, as hereinabove described, the 

playback time management information is specified as the edit information 
along with the specified playback range so that the playback time for the 
specified playback range with respect to the timer time (playback reference 
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time) can be arbitrarily adjusted on the basis of the playback time 
management information without changing the data body, and arbitrary 
parts can be readily extracted and continuously output firom the 
multimedia information file. 

Further, operation creating a new multimedia information file from 
the source mtiltimedia information file and edit information as an edit 
result is described with reference to Figs. IIA to llC. When the part A 
(time stamps 1 to 2) and the part B (time stamps 6 to 8) are extracted from 
the multimedia information fide X and simply connected into a single new 
file, the part A and the part B cannot be continuously played due to the 
time stamps similarly to the aforementioned prior art, as described above. 

According to this embodiment, therefore, the time stamp change part 
15 reaffixes time stamps to the edit result with the playback time 
management information included in the edit information and the header 
appending part 16 thereafter appends header control information, for 
creating a single new multimedia information file. 

As shown in Fig. 11 A, the playback time management information 
for the part A is the offset 1, and hence those obtained by subtracting 1 
from the source time stamps are appended as new time stamps. Similarly, 
the playback time management information for the part B is the offset 4, 
and hence those obtained by subtracting 4 firom the source time stamps are 
appended as new time stamps. 

As described above, the part A and the part B can be continuously 
played and output as shown in Fig. 8 in a new multimedia information file 
Y (Fig. IIC) created by reaffixing the time stamps obtained from the 
playback time management information included in the edit information to 
the part A and the part B extracted and connected from the multimedia 
information file X, as understood firom the values of the time stamps. 

The multimedia information file is generally managed with reference 
to a management unit of a certain determined length, and hence dummy 
data may be appended in addition to a motion picture and a voice/audio as 
shown in Figs. 12A to 12D also in the new multimedia information file Y 
(Fig. IIC), in order to match multimedia information data of an arbitrary 
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length with integral times the prescribed management unit. 

If dummy data is appended when medium data such as video data or 
audio data is coded, the data body is formed by directly embedding the 
dummy data in the generated coded data itself as shown in Fig. 12A. 

If dummy data is appended when medium data such as video data or 
audio data is packeted and multiplexed, a packet (dummy data packet) 
formed by dummy data is multiplexed and appended similarly to other 
packets including the medium data, as shown in Fig. 12B. In this case, 
the dummy data packet itself has information related to the packet length, 
and the dummy data packet is skipped on the basis of this information. 

If dummy data is appended when the file is created, further, only 
index information is extracted from header control information and 
arranged at the back of the data body, as shown in Fig. 12C and Fig. 12D. 
This is because the index information is unnecessary for streaming 
playback and hence playback can be quickly started when streaming 
playback is performed, due to this arrangement. 

Fig. 12C shows a case of stuffing a clearance between header control 
information and a data body or between the data body and index 
information with dummy data. In this case, a series of "0" invalid as the 
head of the data body or the index information, for example, may be stuffed 
in the inserted dummy data to be sought until the next head is detected in 
the dummy data part, or the size of the dummy data area may be expHdtly 
indicated on the head portion of the dummy data area so that the dummy 
data area is skipped. 

Fig. 12D shows a case of appending and stuffing dummy data to the 
tail end positions in the respective ones of header control information and a 
data body. In this case, both of the actual size of the header control 
information or the data body including the dummy data and the effective 
size of the header control information or the data body not including the 
dummy data may be recorded in an area other than the dummy data area 
to be utilized for skipping the dummy data, or the dummy data area itself 
may have size information as described above with reference to Fig. 12 C. 

In the editing appeiratus according to the aforementioned first 
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embodiment, the playback object file extract part 12 extracts the desired 
multimedia information file on the basis of the playback object file ID read 
in the edit information read part 1 1 and outputs the mvdtimedia 
information file to the time stamp read part 1. Alternatively, the playback 
5 object file extract part 12 may extract only the playback range of the 

desired multimedia information file in response to the playback object file 
ID, the playback start position and the playback end position read in the 
edit information read part 11 and output the playback range to the time 
stamp read part 1. 

10 (2) Second Embodiment 

A second embodiment of the motion picture editing method and the 
motion picture editing apparatus according to the present invention is now 
described with reference to Fig. 13 to Fig. 18C as to operation of connecting 
and playing a plurality of multimedia information files. The same 

15 reference numerals are assigned to parts identical to those in the first 
embodiment, and redundant description is not repeated. 

Referring to Fig. 13, the editing apparatus according to the second 
embodiment is different from the editing apparatus according to the 
aforementioned first embodiment in a point that a header appending part 

20 26 is provided as a file creation part 27 for appending header control 

information including new edit information obtained on the basis of the 
contents of edit information read in an edit information read part 1 1 to 
multimedia information data played and output from a playback control 
part 4. 

25 According to this embodiment, two multimedia information files A 

and B are connected and played as shown in Fig. 14A and Fig. 14B, while 
source data bodies themselves are not manipulated, similarly to the 
aforementioned first embodiment. In current edit information a, a 
playback start position, a playback end position and playback time 

30 management information are described for each playback object file, as 
shown in Fig. 14B. 

The playback start position and the playback end position can be 
specified with time information (a time stamp and a playback time), a 
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physical storage position, a packet number or the like, as described above. 
An offset value is employed as the playback time management information. 

The file A may be played and output along the time stamp, and 
hence the offset value of the playback time management information is 0. 
5 Further, the overall data of the file A is pointed as the playback range by 
setting the playback object file ID to A, the playback start position to 0 and 
the playback end position to ta. 

In order to start playing the file B at a time tcl (= ta), a playback 
time management information offset value is set to -ta. Further, the 
10 overall data of the file B is pointed as the playback range by setting the 
playback object file ID to B, the playback start position to 0 and the 
playback end position to tb. 

When the data are played according to this edit information a, the 
data of the file A can be played between timer times 0 and tcl and the data 
15 of the file B can be played and output between timer times tcl and tc2 (= ta 
+ tb). 

According to this embodiment, as hereinabove described, a plurality 
of multimedia information files can be readily connected, played and output 
without changing data bodies by specifying respective specified playback 
20 ranges and playback time management information for the playback 
ranges for the plurahty of playback object files as edit information. 

In the edit information a shown in Fig. 14B, the playback objects 
point the overall data bodies from first to last. Thus, when the overall 
data bodies in the playback object files are the playback objects, description 
25 of the playback start positions, the playback end positions or durations may 
be omitted in the edit information a, as shown in Fig. 15A. 

When the playback ranges are not explicitly indicated in the edit 
information a, the overall data bodies in the playback object files are 
interpreted as the playback objects. In this case, the edit information read 
30 part 11 shown in Fig. 13 supplements and outputs the omitted information 
of the playback ranges. 

Further, the first playback time management information can be 
omitted as shown in Fig. 15B, only when the same is the first element in 
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the edit information and the playback time management information is 0. 
In this case, the edit information read part 11 shown in Fig. 13 
supplements and outputs the omitted playback time management 
information. Further, the edit element number may be omitted when the 
5 number of edit elements may not be explicitly indicated. 

Operation of creating a new multimedia information file from source 
multimedia information files and edit information as an edit result is 
described with reference to Figs. 16A and 16B. 

When a file A and a file B are connected for creating a new single file 

10 C to which header control information is appended as shown in Figs. 16A 
and 16B, time stamps of a part copied from the fide A may remain as such 
in the file C, while those obtained by adding ta to the source time stamps 
must be reaffixed as to time stamps of a peirt copied from the file B. 

According to this embodiment, therefore, the header appending part 

15 26 creates edit information a3 specifying offset -ta as playback time 

management information for the part copied from the file B and stores the 
edit information aS in header control information of the new file C, thereby 
adding ta to the time stamps of this part in playback and implementing a 
function similar to that reaffixing the time stamps. 

20 Thus, the edit information is stored as part of the header control 

information of the new multimedia information file and the head and the 
taQ of the data body (data body extracted from the source multimedia 
information files) of the new multimedia information file are pointed as a 
playback start position and a playback end position respectively while 

25 information corresponding to a playback time of the data body head is set 
as playback time management information. 

In other words, the edit information stored as the header control 
information of the new multimedia information file specifies the difference 
(offset) between the time to start playback and the playback time (time 

30 stamp value) of the data body head as the playback time management 
information. 

Thus, when a new file is created from part of the data body of a 
certain file, time stamp values may not be rewritten over the entfre data 
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body for matching the playback time of the data body head with the time to 
start playback but the data body including a large quantity of information 
may be simply copied or rearranged in the file, whereby the processing can 
be extremely simplified. 
5 When the edit information is included in the multimedia information 

files as the edit information a3 shown in Fig. 16B and the multimedia 
information files including the edit information are to be played, 
description of the playback object file IDs may be omitted within the edit 
information a3, as shown in Fig. 17. 

10 When the playback object file IDs are not expHcitly indicated in the 

edit information a3, the multimedia information files including the edit 
information aS are interpreted as the playback object files. In this case, 
the edit information read part 11 shown in Fig. 13 supplements and 
outputs the omitted playback object file IDs. 

15 (3) Third Embodiment 

A third embodiment of the motion picture editing method and the 
motion picture editing apparatus according to the present invention is 
described with reference to Fig. 18A to Fig. 20 as to operation of dividing a 
single multimedia information file into a plurality of files and playing the 

20 files. The same reference numerals are assigned to parts identical to those 
in the aforementioned second embodiment, and redundant description is 
not repeated. 

According to the third embodiment, a file A is divided into two 
multimedia information data and played as shown in Fig. 18A, while the 

25 source data body itself is not manipulated similarly to the first embodiment. 

Edit information a corresponding to the first half part (time stamps 0 
to tal) after division and edit information P corresponding to the second 
half part (time stamps tal to ta2) after division are set, while playback 
start positions, playback end positions £ind playback time management 

30 information of the respective ones are described, as shown in Fig. 18B and 
Fig. 18C. Offset values are employed as the playback time management 
information. 

The time stamps of the part (the first half part after division) 
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extracted by the edit information a start from 0, and hence the playback 
time management information in the edit information a may be the offset 
value 0. When playback is performed according to this edit information a, 
therefore, data of the first half part after division can be played and output 
5 between timer times 0 and tb (= tal). 

On the other hand, the time stamps of the part (the second half part 
after division) extracted by the edit information j3 start from tal, and hence 
the playback time management information in the edit information p! is set 
to the offset value tal. When playback is performed according to this edit 
10 information therefore, data of the second half part after division can be 
played and output between timer times 0 and tc (= ta2 - tal). 

According to this embodiment, as hereinabove described, a single 
multimedia information file can be divided so that any divided data can be 
played and output from the time 0 without changing the data body, by 
15 setting mxiltiple edit information corresponding to data parts after division. 

Operation of creating new multimedia information files from a source 
multimedia information file and edit information as an edit result is 
described with reference to Fig. 19. 

Also in this case, new edit information including playback time 
20 management information describing the difference (offset) between a 

playback start time initial value and a playback time (time stamp 1) of a 
data body head may be stored in the new multimedia information files after 
division, similarly to the aforementioned second embodiment. 

When a file A is divided for creating a file B and a file C, for example, 
25 time stamps in the file B may not be reaffixed but time stamps in the file C 
must be reaffixed, as shown in Fig. 19. 

Therefore, edit information a2 is introduced into header control 
information of the file C, thereby adjusting the values of the time stamps 
on the basis of playback time management information included in the edit 
30 information a2 when the file C is played and implementing a function 
similar to that reaffixing the time stamps. 

When the edit information is included in the multimedia information 
file as the edit information a2 shown in Fig. 19 and the overall data body is 
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to be played from first to last, description of both of a playback object file ID 
and a playback range may be omitted within edit information a, as shown 
in Fig. 20. 

When the playback object file ID and the playback range are not 
5 explicitly indicated in the edit information a2, the overall data body in the 
multimedia information file including the edit information a'2 is interpreted 
as the playback object. In this case, the edit information read part 11 
shown in Fig. 13 supplements and outputs the omitted playback object file 
ID and playback range. 
10 (4) Fourth Embodiment 

A fourth embodiment of the motion picture editing method and the 
motion picture editing apparatus according to the present invention is 
described with reference to Fig. 21 as to operation of extracting, connecting 
and plajang single parts of a plurality of multimedia information files. 
15 The same reference numerals are assigned to parts identical to those in the 
aforementioned first to third embodiments, and redundant description is 
not repeated. 

According to this embodiment, single parts are further extracted and 
connected from an edit result extracted and connected from a file A and a 

20 file B by edit information a and an edit result extracted and connected from 
a file C by edit information p to be played and output as shown in Fig. 21, 
while source data bodies themselves are not manipulated similarly to the 
aforementioned first embodiment. 

As shown in Fig. 21, the edit information a describes information for 

25 connecting data obtained by extracting parts of time stamps tal to t2 from 
the file A with data obtained by extracting peirts of time stamps tbl to tb2 
from the file B. The edit information p describes information for 
extracting parts of time stamps tcl to tc2 fi:om the file C. It is assumed 
that the edit information a and the edit information P already exist as files 

30 different fi:om the source multimedia information files A, B and C. 

Further, when data obtained by extracting a part (time stamps tdl to 
td2) of the edit result defined according to the edit information a is 
connected with data obtained by extracting a part (time stamps tel to te2) 
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of the edit resxdt defined according to the edit information 3, the edit 
information a and the edit information p can he specified as playback object 
files in the current edit information. 

In other words, compHcated edit contents can be simply described by 
5 setting playback object file IDs to a and |3 in edit information yl while 

setting playback start positions, playback end positions and playback time 
management information of the respective files to tdl, td2, tdl, tel, te2 and 
tel - te2 + tdl with times on the edit results formed by the edit information 
a and the edit information j3. 

10 The edit information a refers to the source files A and B while the 

edit information p refers to the source file C, and hence contents similar to 
those of the aforementioned edit information yl can be described as edit 
information y2 with reference to the files A, B and C. This edit 
information y2 specifies the source files A, B and C as the playback object 

15 files, and the playback start positions, the playback end positions and the 
playback time management information are responsively described as 
foUows: 

The playback range is described as time stamps ta3 (= tdl + tal) to 
ta2 and the playback time management information is described as offset 

20 tdl + tal in the file A, the playback range is described as tbl to tb3 (td2 + 
tbl - ta2 + tal) and the playback time management information is 
described as offset tbl - ta2 + tdl + tal in the file B, and the playback 
range is described as tc3 (= tel + tel) to tc4 (= te2 + tel) and the playback 
time management information is described as offset tel + tel - td2 + tdl in 

25 the file C. 

Thus, also when a certain edit result is further edited, the edit 
information a and the edit information p are not referred to as the playback 
objects as in the edit information yl but the source multimedia information 
files A, B and C are referred to as in the edit information y2, so that the 

30 result edited with the edit information y2 is not influenced even if the edit 
information a and the edit information P are erased later. 

While the playback object file ID cannot indicate whether the edit 
information is pointed or the data body is pointed as the playback object 
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when the edit information is embedded and stored in the source multimedia 
information file, the playback start position or the playback end position 
may be described as Edit- 10 or Video-8, for example, in a format capable of 
specifsdng whether the playback object is the edit information or a medium 
5 included in the data body in this case. 

According to this embodiment, as hereinabove described, a plurality 
of multimedia information files can be extremely simply subjected to 
comphcated editing to be played and output without changing data bodies, 
by specifying existing edit information as the playback object files of edit 
10 information. 

(5) Fifth Embodiment 

A fifth embodiment of the motion picture editing method and the 
motion picture editing apparatus according to the present invention is 
described with reference to Figs. 22A to 22G as to operation of connecting 

15 and plasring a plurahty of multimedia information files including edit 
information in the files. The same reference numerals are assigned to 
parts identical to those in the aforementioned fijcst to fourth embodiments, 
and redundant description is not repeated. 

According to this embodiment, a file A and a file B are connected, 

20 played and output with edit information p, as shown in Figs. 22A to 22C. 
Source data bodies themselves are not manipulated, similarly to the first 
embodiment. Time stamps start fi:om tbl and end at tb2 in the file B, and 
this file includes edit information a describing the time stamp tbl as 
playback time management information. 

25 When the presence of the edit information a is not taken into 

consideration, edit information 3 may be described as shown in Fig. 22D. 
The edit information P can be described with no edit information a in the 
file B by providing such a rule that the edit information P present as a file 
diEferent from the files A and B to be edited is preferential to the edit 

30 information a in the file B. 

When the presence of the edit information a in the file B is utilized 
to the contrary, the edit information p can be described as shown in Fig. 
22E, While finally edited playback time management information is to be 
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tbl - ta as shown in Fig. 22D, the edit information a already describes tbl 
as the playback time management information and hence the edit 
information j3 may describe only -ta. The information tbl - ta is obtained 
by summating tbl and -ta. 
5 In this case, management of the playback time of the file B can be 

left to the edit information a, and hence the time stamps of the file B may 
not be observed but only the edit information a may be observed when the 
edit information p is generated. In the edit information p shown in Fig. 
22E, playback start positions, playback end positions etc. which can be 

10 omitted are omitted as described in relation to the fixst embodiment with 
reference to Fig. 15. 

Further, the edit information a already present in the Gle B may be 
rewritten in this case. In other words, the playback time management 
information tbl - ta for the file B, described in the edit information P in Fig. 

15 22D, is described in the edit information a as shown in Fig. 22G. Further, 
no playback time management information is described but only the 
playback object file ID is described in the edit information P, as shown in 
Fig. 22F. Thus, the processing can be simplified when a new multimedia 
information file is created as an edit result. 

20 

Industrial Applicability 

In the motion picture editing method and the motion picture editing 
apparatus according to the present invention, as hereinabove described, a 
desired playback range is selected fi:om motion picture data recorded on a 

25 recording medium and playback information of the playback range is 

extracted along with playback time information so that edit information for 
playing the extracted range is appended to the recording medium on the 
basis of the extracted playback information and playback time information, 
whereby a desired motion picture can be edited with the edit information 

30 without changing the source playback information. 
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CLAIMES 

1. (amended) A motion picture editing method editing motion picture data 
played and output from a motion picture file 111, 113 stored on a recording 

5 medium 101 and having a motion picture data body formed by arranging 
time management information and motion picture data corresponding to 
said time management information in temporal order, said method 
comprising steps of: 

previously specifying at least one playback range in the motion 
10 picture file 111, 113 and a playback time of said playback range; 

appending information for managing the specified playback range 
and the playback time of the playback range to an area other than said 
motion picture data body on said recording medium 101 as edit information 
112; and 

15 outputting motion picture data of the specified range in said motion 

picture file 111, 113 at said specified time on the basis of said time 
management information and said edit information. 

2. The motion picture editing method according to claim 1, further 

20 comprising a step of changing the time management information in said 
output motion picture data on the basis of said edit information 112 and 
creating a new motion picture file. 

3. (amended) The motion picture editing method according to claim 1, 
25 further comprising a step of appending edit information including 

information for managing the playback time for said output motion picture 
data to an area other than the motion picture data body on said recording 
medium and creating a new motion picture file. 

30 4. (amended) A motion picture editing method editing motion picture data 
played and output from a motion picture file 111, 113 stored on a recording 
medium 101 and having a motion picture data body formed by arranging 
time management information and motion picture data corresponding to 
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said time management information in temporal order, said method 
comprising steps of: 

previously specifying at least one playback range in said motion 
picture Gle 111, 113 and a playback time of said playback range; 
5 appending information for managing the specified playback range 

and the playback time of the playback range to an area other than said 
motion picture data body on said recording medium 101 as first edit 
Pi information; 

S defining an edit result in said motion picture file on the basis of said 

r£ 10 time management information and said first edit information; 

further specifying at least one playback range in said edit result and 
ll^l a playback time of said playback range; 

%l appending information for managing the specified playback range 

1, and the playback time of the playback range to an area other than said 

p 15 motion picture data body on said recording medium 10 1 as second edit 
information; and 

p outputting motion picture data of the specified range ia said motion 

picture file at the specified time on the basis of time management 
information in said edit result and said second edit information. 

20 

5. (deleted) 

6. (deleted) 

25 7. (deleted) 

8. (amended) A motion picture editing apparatus editing motion picture 
data played and output from a motion picture file 111, 113 stored on a 
recording medium 101 and having a motion picture data body formed by 
30 arranging time management information and motion picture data 

corresponding to said time management information in temporal order, 
comprising: 

means 121 specifying a desired playback range and a playback time 
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LO 



of said playback range; 

means extracting specific information of said specified playback 
range and said playback time information; 

means 122, 123 creating edit information on the basis of said 
extracted specific information and playback time information and recording 
said edit information in an area otber than said motion picture data body 
on said recording medium 101; and 

playback means playing said playback range at said specified time 
on the basis of said edit information. 



9. (amended) The motion picture editing apparatus according to claim 8, 
wherein 

said specify means 121 specifies a plurahty of said playback ranges, 

and 

15 said playback means continuously plays said plurality of playback 

ranges. 

10. (added) The motion picture editing apparatus according to claim 8 or 9, 
wherein 

20 said playback means includes: 

edit information read means 11 reading information for managing at 
least one playback range in the motion picture file and a playback time of 
said playback range, 

playback object file extract means 12 extracting a prescribed motion 
25 picture file on the basis of the information for managing the playback range 
read in said edit information read means 11, 

time management information read means 1 readLag time 
management information in motion picture data included in the motion 
picture file extracted in said playback object file extract means 12, 
30 playback time adjustment means 13 carrjdng out a prescribed 

operation on the time management information read in said time 
management information read means 1 and calculating a specified 
playback time on the basis of the information for managing the playback 
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time read in said edit information read means 1 1, 

compare means 3 comparing the specified playback time calculated 
in said playback time adjustment means 13 with a time counted by a 
playback timer 2, and 

control means 4 outputting motion picture data of the specified range 
in said motion picture file on the basis of a result of comparison in said 
compare means 3. 

11. (added) The motion picture editing apparatus according to claim 10, 
further comprising time management information change means 15 
changing the time management information in the motion picture data 
output from said control means 4 to the playback time calculated in said 
playback time adjustment means 13. 

12. (added) The motion picture editing apparatus according to claim 10, 
further comprising edit information appending means 16 appending edit 
information including information for managing the playback time for the 
motion picture data output from said control means 4 to an area other than 
the motion picture data body on said recording medium. 

13. (added) The motion picture editing apparatus according to claim 12, 
wherein a new motion picture file including said motion picture data and 
the edit information appended to said motion picture data is created. 

14. (added) A motion picture playback apparatus playing a motion picture 
file stored on a recording medium and having a motion picture data body 
formed by arranging time management information and motion picture 
data corresponding to said time management information in temporal order, 
comprising: 

edit information read means 11 reading edit information appended to 
an area other than said motion picture data body on said recording medium 
101 and including information for managing a playback time of said motion 
picture data; 
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time management information read means 1 reading time 
management information in said motion picture data; 

playback time adjustment means 13 carrying out a prescribed 
operation on the time management information read in said time 
management information read means 1 and calculating a specified 
playback time on the basis of the information for managing the playback 
time read in said edit information read means 1 1; 

compare means 3 comparing the specified playback time calculated 
in said playback time adjustment means 13 with a time counted by a 
playback timer; and 

control means 4 outputting motion picture data in said motion 
picture file at the specified time on the basis of a result of comparison in 
said compare means 3. 

15. (added) The motion picture playback apparatus according to claim 14, 
wherein 

said edit information includes information for managing at least one 
playback range in said motion picture file and a playback time of said 
playback range. 

16. (added) The motion picture playback apparatus according to claim 14 
or 15, further comprising time management information change means 15 
changing the time management information in the motion picture data 
output fiom said control means 4 to the playback time calculated in said 
playback time adjustment means 13. 

17. (added) The motion picture playback apparatus according to claim 14 
or 15, further comprising edit information appending means 16 appending 
edit information including the playback time for the motion picture data 
output from said control means 4 to an area other than the motion picture 
data body on said recording medium 101. 

18. (added) The motion picture playback apparatus according to claim 17, 
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wherein a new motion picture file including said motion picture data and 
the edit information appended to said motion picture data is created. 

5 19. (added) A motion picture editing method appending to a motion 
picture data body stored on a recording medium and formed by time 
management information and motion picture data corresponding to said 
time management information in temporal order edit information including 
information for managing a playback time of said motion picture data and 
10 creating a new motion picture file, said method comprising steps of: 
preparing said edit information; and 

appending said edit information to an area other than said motion 
picture data body on said recording medium 101. 

15 20. (added) The motion picture editing method according to claim 19, 
wherein 

said edit information is included in said new motion picture file. 
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ABSTRACT 



A motion picture editing apparatus edits motion picture data played 
and output from a motion picture file stored on a recording medium 101 
and having a motion picture data body 111 arranged in temporal order 
along with time management information. The motion picture editing 
apparatus includes a playback object file extract part 12 extracting a 
desired playback range firom the motion picture file, and the extracted 
playback range has a prescribed playback time. The motion picture 
editing apparatus has a file creation part 17 for storing information for 
managing the extracted playback range and the playback time of the 
playback range in an area other than the motion picture data body on the 
recording medium 101 as edit information 112. 
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DECLARATION AND POWER OF ATTORNEY 
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next to my name. I believe I am the original, first and sole inventor (if only one name is listed at 201) below or an original, first 
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Ernest v. Linek (Reg. No. 29,822) Peter J. Manus (Reg. No. 26,766) 
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